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INTRODUCTION 


Limited techniques are available to assist in preliminary instrument 
panel design or optimization of an existing panel design configuration. 
The primary criterion that is currently being used for equipment arrange- 
ment is dependent on one or more of the following basic principles: 

(1) how important the instrument is, (2) the degree of relative use of 
the instrument, (3) the grouping of similar instruments together, and 

(4) the degree of related sequential use. Data gathering techniques 
utilized are usually either direct or recorded observations of movements, 
user interviews or information received from questionnaires. The 
majority of effort on visual sampling of displays and on eye movement has 
been conducted in support of aircraft instrument panel layout. Panel 
arrangement and pilot instrument scanning became critical with the advent 
of high speed aircraft and when, due to the state-of-the-art capability, 
more sophisticated instrumentation evolved in response to more stringent 
system requirements. 

Commonly utilized link analysis techniques provide information which 
can be applied toward solving two system problems: optimal arrangement 
of men and machine and optimal instrument panel design (Chapanis, 1959). 
By utilizing a flow diagram the links between various components are 
expressed in statistical terms. The analysis is of greatest value in 
solving problems of layout and arrangement. Two classes of links can be 
considered: functional and sequential. The functional links are first 
order approximations based on frequency of eye fixation or the importance 
of the connections between men, or between men and the equipment com- 


ponents in question. They are the statistical probabilities indicating 





how much a particular connection between men, or men and equipment takes 
place, for example a proportion of total eye fixation on an instrument. 
The second order approximation sequential links relate to human movements 
between equipment components, reflecting the frequency of the relation- 
ship and are a statistical indication of how equipment components are 
related and the dependence of one on the other. 

Link values in operational procedures are often derived by a graphic 
approach in which the sequential steps in the operation are recorded. 

A graphic method was utilized by Jones, Milton and Fitts (1950) in their 
classic study of the layout of aircraft instruments. The basic data 

were obtained by using a motion picture camera that recorded the sequence 
of eye movements made by numerous pilots during various flight maneuvers. 
From the data, sequential link values between the instruments were 
determined (% of eye shifts between instruments). Functional link 

values were also calculated showing: average length of eye fixation, 
number of fixations per minute and proportion of time spent on viewing 
rl instrument, 

The information from the study was utilized to develop the standard 
primary aircraft instrument arrangement now found in most aircraft. The 
basic concept called for the most frequent ly used instruments to be 
mounted in the center of the panel. Instruments with high link values 
or sequential transitional probabilities should be located adjacent to 
the central instruments. This arrangement minimized required pilot eye 
movements. The contribution of the link analysis is in providing 
Suggested ways for arrangement that will assist in optimizing the panel 


design (Chapanis, 1959). 





Senders (1964) later demonstrated that the sequential link prob- 
abllities were predictable on the basis of the individual instrument 
fixation probabilities. Knowledge of the fixation probability, Dos; 
which can be estimated by the relative sampling frequency of the display, 
enables the approximate calculation of the link value, p,, , between two 


instruments, a and b, by the formula 


Pab -— 


z 2 
l. (p; °) 
1=1 
where n = number of instruments on the panel. 


Application of this theory to the study made by Jones, et al provides 
results which are in substantial agreement for instruments scanned most 
frequently (those of prime importance). Greatest variability was found 
for instruments with low fixation probabilities. This predictability 
theory is considered valid for laying out an instrument panel design. 

McRuer, et al used the prediction technique of Senders to predict 
the link values for an aircraft Integrated Landing en (Frost, 1971); 
two recommended panel designs evolved from the predictions. Both designs 
were found to be substantially the same configurations adopted indepen- 
dently by two airlines and certified by the Federal Aviation Administration. 
The use of the prediction technique has developed as a useful tool in 
preliminary design work. 

In complex systems which have many components, a quantitative 
approach utilizing linear programming might be justified. This approach 


is a statistical method that results in the optimization of some criterion 





or dependent variable by manipulation of various independent variables 
(McCormick, 1970). The Freund and Sadosky (1967) report often cited in 
human-factors literature presents several types of arrangement problems 
which in common involve two independent criterion measures: (1) fre- 
quency of use of each control or display instruments and (2) an error 
score for each available area or position of the panel. The goal is to 
assign each component to a specific position so as to satisfy an objective 


function of the form 


m 
Minimize x L f.e 
j 


where Е. is the frequency of use of display i and °; is the absolute of 
relative errors attached to position j. 

While a moderate amount of work has been conducted on the develop- 
ment of link value concepts and on their use in panel redesign, virtually 
no work exists on determining stable estimates of probabilities and link 
values for use in panel redesign, an Ten in the engineering 
effort. If data are gathered in a preliminary configuration, in a simu- 
lator, or other similar system, then these data can be applied to the 
engineering redesign effort. While it is true that the redesigned system 
may cause some changes by virtue of the fact that it has been changed, it 
is probably true in most cases that this effort will provide a system 
superior to one based strictly on intuition or design hunches. 

There are many known applications of data stability and record 
length estimation used in engineering. However, a literature search 


conducted indicates a total lack of information on the stability of human 





operator eye movement data and estimation of record lengths to obtain 
certain desired accuracies in the estimate. It is the intent of this 
research to provide information that is pertinent to these areas. In 
conducting this research effort first order probabilities will be con- 
sidered. It is demonstrated in Appendix A and was previously discussed 
in Senders' work that in most cases accurate estimates of second order 
probabilities can be obtained from first order probabilities. Nothing 
in the development of this research is intended to restrict its gener- 
ality in application. The techniques used herein can be applied to any 
engineering effort investigating optimizing an instrument panel design. 
Once a model has been developed it should provide a general technique 
for handling the optimum design and layout of any sort of instrument panel 
utilized in a dynamic man-machine system. For optimum system design as 
viewed from the life cycle standpoint in the system engineering process 
the most powerful tools available must be employed. It is the object of 
this research to provide additional tools for the system and design 
engineer to assist them in the development of optimum instrument panel 


configurations early in the design process. 





THEORETICAL MODELS FOR ESTIMATING RECORD LENGTH 


Only recently has a theory been proposed on the determination of 
record length estimation for taking data in support of a panel redesign. 
The procedure developed is based on the assumption that eye fixation 
probability estimates for fixed length segments of time follow a normal 
Statistical distribution (Wierwille, 1973). There is no known previous 
examination of the problem of record length estimation for taking data in 
support of a panel redesign. 

Normal Model 

The central limit theorem states: If x is the mean of a random 

sample of size n taken from a population having the mean H and the finite 


š 2 
variance 0”, then 


ун Ди, 
om 


is the value of a random variable whose distribution function approaches 
that of the standard normal distribution as n approaches infinity. When 
the sample mean x is used to estimate the mean of a population chances 


are Slim that this estimate is exactly equal to the mean y . The error, 


x -ul, is the difference between the two quantities. Using the fact 


x - MH 
o n 
mately that of the standard normal, it can be stated with a probability of 











that for large n the random variable has a distribution approxi- 


1 - og that 


- Ы 
“üm “9/2 





a < 





where z is such that the normal curve area to its right equals a/2 


072 


(two sided). Therefore, by estimating H by means of a random sample of 


x - ul, 





size n it is stated with a probability of 1 - a that the error 
is less than 27, o/vn for large values of n. Rearranging the double 


inequality, the confidence interval of Hu having the degree of confidence 


1 - QA can be found from the equation 


= () — О 
Xo apa US X + 27 - 


Thus it can be claimed with a probability of 1 - w that the interval from 


= — + 3 
Х - 2 /2/2 tO X + Zą/2⁄ī contains H 


It must be absolutely clear what is meant by the previous statements 
pertaining to the claim that with a probability of 1 - q that the interval 
contains U . Since the mean of the given population either is or isn't 
contained in the interval it is not reasonable to address the probability 
of such an event. What is meant however is that in repeated sampling a 
confidence of a percent of the confidence intervals obtained will contain 
the mean of the population. Thus one will obviously not know with 
certainty if the population mean is contained in the confidence interval 
but it is known with certainty that when this procedure is utilized to 
K I io interval estimates, it is a percent reliable. As an example, 
if a random sample of size n = 100 is taken from a population having 


G = 5.1 and we obtain a mean of 21.6, then 0.95 confidence interval for 


1.96 (5.1) 
100 


57 iicre we claim that the interval from 20.6 to 22.6 is a 0.95 


17: piven by 21.6 + , providing an interval from 20.6 to 


confidence interval for the mean of the population is that in repeated 





sampling 95 percent of the confidence intervals obtained contain the 
mean of the population (Miller and Freund, 1965). 

It is often desired and a design requirement to calculate the sample 
size required to reduce the confidence interval a given percentage. In 


general, the variance of the sample mean decreases as 1. and the standard 


n 
deviation decreases as E Therefore, the confidence interval shrinks 
n 
as 1 , and the following relationship applies 
n 
g 
Z = = ‘ : : 
a/2 vn _ (x)(% reduction of confidence interval) 
7 100 yn 
vhere 


(x) (% reduction of confidence interval) = tolerance of the mean. 


The application of Wierwille's theory to data taking in support of 
panel redesign assuming a normal distribution, where the data mean and 
variance are assumed to be without error, follows the sequential steps: 

a From : sample of data break the data into n observation inter- 
vals of equal length t seconds. 

2. Select a typical variable say p, (instrument number 2 fixation 
times) on which to apply the theory. \ a 


5., Calculate the sample probabilities, :Рәә where i=l through the 


n observation intervals. 


4. Calculate the sample mean for the n samples from the relation- 
n 
ship 5:17 
ә 
n 
>. Calculate the sample variance from the relationship 


n 
2 —2 
s2 _1=1 („Pa = x) 


n-l 





6. Enter the normal distribution table for the desired confidence, 
determine the value of 20/27 and calculate the confidence limits from 


the relationship 


— 


= c x + O 
20 eo Ce ° 
i 
where © is approximated by s. 
” Determine the amount by which the confidence limits must be 


reduced by calculating the required data length new from the relationship 


e 


g ` 2 
Gr vi, (Yn) 
New xy 
where 


y = % reduction of the confidence interva1/100. 


Sample Problem (Normal Model): 
Eye movement data are broken into 8 consecutive sample intervals of 
20 seconds each. Fixations on instrument number 2 appear typical. Values 


of p, estimated for each sample interval are as follows: 


0.50 Dr 
BD = 0.2 | 62 20.29, ™ 
570 = 0.16 1: 
AED 0.41 8P2 - 0.39 


The sample mean and variance are calculated: 


məiP? Be.) 
i=] 2 i=] ¿Po 


- = 0.275 ı :5- sunun en 0.0096, g =~ 0.098 . 
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From the normal probability table obtain the q point of a normal 


distribution for a confidence limit of 80% 


2 = 20.1 = ДӘ 


The confidence limits are 


Do (1.25 010096 en, 208073 4 (L 252) (0: 098) 
v8. VE 


0.229 < p< 0.317 (chances are 8 out of 10 that the fixations 
on p> will be within the probability interval). 
The record length required to reduce the confidence interval to + 10% 


1s calculated as 


n  =  |((.282)(0.098)/(v8)) (8) = 21.17 
new (0.10) (0.273)/100 l 
and rounding off 
n = 22. 
new 


Consequently, according to this theory, 440 seconds of data should 


be taken to provide an estimate of p> with a confidence interval or + 102. 


t Model 

Use of the normal model requires knowledge of the population standard 
deviation O. If n is large the theory can be applied when g is unknown, 
in which case the sample standard deviation s is used. Little is known 


about the exact distribution of the statistic XAH for small values of 
s/vn 

n unless the assumption is made that the sample comes from a normal popu- 

lation. If however x is the mean of a random sample of size n taken from 


a normal population having the mean y and the variance of, then 





a 


t=X -H 





s/m 


is the value of a random variable having the t distribution with the 
parameter v= n - 1 (Miller and Freund, 1965). Like the standard normal 
distribution the t distribution has the mean O but its variance depends 
on the parameter v, called the number of degrees of freedom. 

Thus as in many practical problems when the sample standard deviation 
is utilized and it is reasonable to assume that sampling is from a normal 
Donation, it is possible to construct exact confidence intervals. 
Therefore x - ty /2 s/M < u<x + t. /2 s/Vn gives with a probability of 
1 - q@ an exact 1 - a confidence interval for u for random samples of 
size n where the distribution does not display pronounced departure from 
normality. Similarly as was shown for the normal distribution model ne 
can be determined to reduce the confidence interval a specified amount. 

The application of the theory to data taking in support of panel 
redesign assuming a t distribution has the following steps: 

il From a sample of data break the data into n observation inter- 
Vals of equal length t seconds. 

2. „Select a typical variable, say P,, (instrument number 2 fixation 
times) on which to apply the theory. “" 

> Calculate the sample probabilities, ¡Pos where iel through the 
n observation intervals. 

4. Calculate the sample mean for the n samples from the relation- 
ship n 
2 ¡P2 


1=1 
n 


x > 





5. Calculate the sample variance from the relationship 


50 
Сур, = X) 


uz 


25 


s“ = 1=1 


n-1 
6. Enter the t probability table for the desired confidence, 
determine the yalue of ya and calculate the confidence limits from the 


relationship 


x =£ S< p< X+t 5 
0/25 a/2 = 
7: Determine the amount by which the confidence limits must be 


reduced by calculating the required data length Be from the relationship 


2 


new 
XY 


0 


where y = % reduction of the confidence interval/100. 


sample Problem (t Model): 

The same problem data given in the sample problem assuming a normal 
distribution will be used in this example to enable a comparison of the 
results of the two models. The same mean and variance previously calcu- 

/ o 
lated are utilized for this illustration 'in assuming a t distribution. 
Starting at step six of the sequential steps outlined for problem 


solution the value of 5 is found from the t probability table 


7 


t = = 
(0.1 15175. 


The confidence limits are calculated to be 


Ve DEE 0.273 + (1-415) (0.098) 
vs a. vs” 





15 


0.224 < Р, < 0.322 (chances are 8 out of 10 that the fixations 
on p, will be within this probability interval). 
The record length required to reduce the confidence interval + 10% 


is calculated as 


((1.415) (0.098) / (V8))(/8) 


a = 26.3 
new (0.10) (0.273)/106 


and rounding off 
HB 27: 

Consequently, according to this theory, 540 seconds of data should 
be taken to provide an estimate of P> with a confidence interval of + 10%. 

The values of the confidence limits and ә for the two sample 
problems are 

Normal Model n = 22 

new 


Ve 


t Model n = 27 
new 
0822272 P, < 0.322. 
A comparison of the results for the two models indicates that the t model 
1s more conservative. A major objective of this thesis is to test the 
hypothesis that the theory has application in the panel redesign problem. 


The thesis will investigate which of the models provides the best fit to 


experimental data collected in support of this research. 





PROBABILITY DISTRIBUTIONS AND PARAMETER ESTIMATION 


When determining the distribution of a random variable such as that 
of eye movement fixation probabilities, three steps must be followed. 
First data must be collected and summarized in a frequency distribution. 
The next step involves calculating or estimating the parameters of the 
hypothesized distribution. Thirdly, it must be determined whether or not 
the hypothesized distribution adequately represents the random variable 
in question. When a plot of the relative frequency distribution has been 
obtained selection of appropriate probability distribution functions be- 
comes a matter of experience and judgment. Once one or more distribution 
classes have been identified as potential, a determination of the numeri- 
cal values of the distribution parameters to reduce the distribution class 
to a specific distribution must be made. An estimate of the sample mean 
and variance can be obtained from the collected data. Having hypothesized 
that a random variable is characterized by a probability distribution, it 
1s determined whether the hypothesis, which is at best just an educated 
guess, is valid. | 

Statistical inference enables the experimenter to draw conclusions 
about a large number of events on the basis of observations of a portion 
of them. This procedure enables testing the hypothesis. Several steps 
are followed in making a determination of the acceptability of the 
hypothesis (Siegel, 1956): 

l. State the hypothesis. 

2, Choose the statistical test for testing the hypothesis. 


Se Specify the significance level (a) and the sample size (n). 
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4. Assume sampling distributions of a statistical type. 

5, Define the region of rejection. 

6. Compute the value of the statistical test. 

In the typical goodness-of-fit statistical test a random sample of 
data is collected and then a test of the hypothesis conducted that the 
sample data was drawn from a population of a specified distribution. The 
Kolmogorov-Smirnov statistical test involves specifying the cumulative 
frequency distribution which would occur under the theoretical distri- 
bution. The point at which the largest deviation exists between the 
theoretical and the observed is calculated. Reference to the sampling 
distribution of the statistical test indicates whether such a divergence 
is likely on a basis of chance. If the sampling distribution is less than 
the observed magnitude then the hypothesis that the data came from the 
postulated distribution is rejected. The significance level, a , indi- 
cates the probability that the statistical test will yield a value under 
which the hypothesis will be rejected when in fact it is true. The above 
procedure will be employed in the analysis of the data collected in this 


research. 





DESCRIPTION OF THE EXPERIMENT 


The objective of the experiment was to collect data to determine eye 
movement fixation probability estimates for fixed length segments of time 
and to test the hypothesized distribution they follow. The data would 
later be utilized to investigate the proposed models for record length 
estimation. 

This research was conducted in the Human Factors Laboratory at 
Virginia Polytechnic Institute and State University, The experiment 
enabled the recording of eye movement data of various subjects who were 
monitoring random signal inputs to four instrument meters. A more com- 
plete description of the hardware apparatus and the actual procedures 
utilized in conducting the experiment follows. 

Figure 1 contains a block diagram of the data gathering system. 
Photographs of the experimental facility are shown in Figures 2, 3, and 
4. Eye movement data were collected utilizing 8 mm movie film. Four 
meter instruments and the motion picture camera were mounted as shown 
in Figures 3 and 4 at an approximate three foot viewing distance from 
the subject. The camera was located in the center of the panel behind 
a half mirror. A KODAK Instamatic M-12 8 mm movie camera recorded eye 
movements. This fixed focus camera was equipped with a 14 mm £/2.7 
KODAK EKTANAR lens and had a shutter speed of approximately 1/40 second, 
A TIFFEN type +1 close-up lens was fitted on the camera to provide a 
sharp picture at a viewing distance of approximately 33 inches, High 


speed super 8 color film, KODAK EKTACHROME 160 (Type A), was utilized. 
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Random input signals previously recorded on four tracks of a FM 
magnetic tape provided the error signal inputs to the four meters. 
These signals were generated by a white noise signal generator, passed 
through a low pass filter and taped for use in conducting the experiment. 


The spectral density of the signal produced by the noise generating 


circuit was Ky? 
Ü (w)=G(jw) G(-jw) = 





0257577 0 000) 


x is an amplitude 


where = is the radian frequency variable and K 
constant. A fifth tract provided timing signals to the experimenter in 
conducting the experiment. This enabled each subject to experience 
identical input signals to the four meters during the experiment and 
ensured that the data collected for analysis covered the same input 
signals for all subjects participating in the experiment, 

The subjects were required to null an error when one was observed on 
a meter. An error was considered to occur when the meter pointer was 
displaced outside of a color coded green tolerance area marked on the 
meter face and was located in a red color coded area located approxi- 
mately thirty degrees to the right and left of the meter pointer 
vertical. The nulling procedure was accomplished by the subject's 
right hand operating one of the four 1K potentiometer controls shown 
in Figure 4. The operation and physical arrangement of these potentio- 
meters eliminated the nced for their direct viewing when being operated. 

The error nulling procedure performed by the subject merely furnished 
the subject with something to do and provided a sense of accomplishment 
in completing the desired task. A wiring schematic for the experiment 


is shown in Figure 5. During the four minute segment of the taped 
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Figure 5. Experimental Facility Wiring Diagram 





random input signals used for data collection, the 2.5K potentiometers 
were initially adjusted so that the meters would read out of tolerance 
the following percentages of the four minute period 


Upper Left 50% Lower Left 40 
Upper Right 30% Lower Right 15 


NN 


Of course, these values assume no corrections are made by the subject. 

A standard brief and practice session was given to each subject 
prior to the actual cata collection run. Emphasis was made on scanning 
all instruments through eye movement. Head movement was noe constrained, 
This ensured a more natural scanning procedure by the subjects. Four 
minutes of continuous eye movement data were recorded for each of the 
subjects. 

Ten different student volunteer subjects, ranging in age from 20 to 
26 years were utilized to collect data. Of the ten subjects two were 
female. Each subject, upon arrival, was asked to read a set of general 
instructions (Appendix B) after which questions concerning the written 
instructions only were answered by the experimenter. The subject was 
then seated in front of the instrument display panel and the seat height 
was adjusted as required for optimum photographic conditions. All sub- 
jects were right handed and their forearm placed comfortably on top of 
the control panel. Subjects were informed that they would be given a 
five minute practice run, during which time they were to get the feel of 
the equipment operation. At the end of the practice run each subject 
was given a two minute rest period. After the rest period the subject 
was given another minute of practice which led directly into a four 


minute data collection run. No communication was conducted with the 


subjects during the data acquisition portion of the experiment. 





EXPERIMENTAL RESULTS 


As stated, ten subjects participated in the experiment to collect 
data on operator eye movement, Data were lost on two subjects: one due 
to a camera malfunction during the data recording phase of the experiment 
and the other due to a misunderstanding of the instructions provided to 
the subject. The data for the remaining eight subjects included that of 
the two female participants. Approximately 3,600 frames of eye movement 
data were collected on film for each of the eight subjects. A frame by 
frame analysis, utilizing an 8 mm movie film viewer, enabled the trans- 
formation of the raw film data into a format required for the investi- 
gation. No ee was encountered in utilizing the viewer, The 
results of the film analysis were considered very accurate, The four 


instruments which the subjects were viewing on the instrument panel were 


identified for the analysis as follows 


A. Upper Left 
Bi Upper Right 
C. Lower Right 
D, Powers Lett. 


From the total number of frames of data obtained from each subject, 
3,520 frames were utilized in the analysis. A determination of what in- 
strument the subject was viewing in each frame of film was made and 
recorded. When the eyes of the subject were observed to be in a transi- 
tion from one instrument to another, the subject was considered for 
analysis purposes to be viewing the acquiring instrument. The identifi- 
cation of the acquiring instrument was determined by advancing the film 
in the viewer by two frames. This philosophy provided consistency 
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in the analysis. In a few cases where determination of what the subject 
was viewing was impossible it was recorded separately as noise for later 
consideration. 

Initially the data were broken into 64 intervals of 55 frames each, 
for a total of 3,520 frames for each subject. This procedure was con- 
ducted for each of the eight subjects over corresponding segments of the 
raw film data. Over each of the 64 intervals the average number of frames 
that the subjects viewed each of the four instruments, A, B, C, and D, was 
calculated and the first order probability of the respective instrument 
being viewed was determined. Of the 512 intervals of 55 frames analyzed 
for the eight subjects, noise was identified in 48 intervals. Of these 
48 intervals, 23 contained one frame of noise, 22 contained two frames of 
noise and three contained three frames of noise. The resultant first 
order probabilities associated with noise were insignificant and were 
disregarded in the remainder of the investigation. The effect this pro- 
cedure had was to cause the sum of first order probabilities in those 
intervals where noise occurred to be slightly less than unity. Having 
obtained the first order eye movement fixation probability estimates for 
fixed length segments of time in each of the 64 intervals, histograms of 
the frequency distribution of the random variable were plotted for each 
of the four instruments. 

Initial consideration in the number of frames comprising each inter- 
val and the total number of intervals allowed straightforward calculations 
in doubling the interval size (i.e., halving the total number of inter- 
vals). Thus, histograms were determined for the eight subject average 


data not only for 64 intervals but also for 32 and 16 intervals. 
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In plotting the histograms 14 bins were utilized to cover the full 
range of first order probabilities that might possibly have been 
encountered (Appendix C). 

In addition to the data on the eight subject average the same 
analysis procedures were performed on a randomly selected subject, 
subject number seven. 

Typical of the frequency distribution found are those depicted in 
Figures 6 through 15. The mean and variance was calculated for each of 
the 24 conditions investigated and are found in Table 1. 

Having summarized the data in a frequency distribution reasonable 
guesses regarding the distribution of the eye fixation probability esti- 
mates for fixed length segments of time were made. Initial consideration 
was given to the Poisson distribution; however since the mean and variance 
for this distribution must be equal and the data clearly indicated this 
not to be the case, this discrete probability distribution was rejected. 
The following continuous probability distributions were considered: 
normal, a normal approximation of the gamma (Appendix D), and the uniform 
distributions. The uniform distribution was primarily considered to 
determine if the goodness-of-fit test that was to be conducted would 
discriminate sufficiently between the hypothesized continuous distribu- 
tions. 

The Kolmogorov-Smirnov goodness-of-fit test was conducted. A tabu- 
lation of the test results is found in Table 2 for the eight subject 
average and Table 3 for subject number seven. As the results indicate, 
in only two cases did the goodness-of-fit test fail and the associated 


hypothesis had to be rejected (subject number seven, 64 interval, gamma 
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TABLE 1. Experimental Values of the Mean and Variance 





Number of Eight Subject Average Subject Number Seven 
Intervals Instrument Mean Variance Mean Variance 
A .52061 .00675 5:71 050.211 

B . 22968 .00512 .22471 0.00581 

FE E .22847 .00454 . 21590 0.00763 

D . 21807 . 00495 .24147 0.00467 

А .52060 . 00438 51 752 0.00579 

B . 22874 .00278 . 22471 0.00224 

É E .23500 .00383 . 21507 0.00318 

D 0227315 0.00219 0.24147 0.00200 

A 0.32060 0.00256 0.30044 0.00416 

B 0.23467 0.00143 0, 22471 0.00130 

b C 0.23500 0.00208 0.21307 0.00195 

D 0.21812 0.00131 0.24147 0.00097 
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TABLE 2. Summary of Results of the Kolmogorov-Smirnov Test 
for the Eight Subject Average 


D Values of Hypothesized 





max 
Number of Cumulative Distributions 
Intervals Instrument Normal Gamma Uniform 
64 A 0.0393 0.0861 0.0512 
B 0.0851 0.0974 0.0593 
D = 
0295 a C 0.0518 0.0647 0.0652 
D 0.0367 0.1190 0.0822 
52 A 0.0408 0.0936 0.0900 
B 0.0729 0.1083 0.0946 
D -:2 : 2 š 
0.95 4 C 0.1330 0.1068 0.1072 
D 0.0192 0.0837 0.0270 
16 A 0.1297 0.0773 0.0741 
B 0.0361 0.0594 020522 
D — 528 : 0.0912 0.0081 
0.95 C 0.0532 091 
D 0.1043 0.0414 0.0928 
.HF72X--::--———. — о === x... 
Since D < D for all cases, any one of the distributions could be 
max 0.95 


used to describe the variable. However, since the value of Ds is more 
consistently least in the normal distribution it would be best to utılıze 


the normal distribution to describe the variable. 





TABLE 3. Summary of Results of the Kolmogorov-Smirnov Test 
for Subject Number Seven 








D Values of Hypothesized 


max 
Number of Cumulative Distributions 
Imtervals Imstrument Normal Gamma Uniform 
64 A 1152 .1806 (Fail) 0: 1512 
B .0792 .1693 051277 
D 5717 C . 0456 2201 (Fail) 0.1024 
0.95 
D . 0698 .1519 0.0571 
22 A ,. 1609 , 1329 0.1198 
B "0386 51214 0.0652 
Do os - .24 C .0709 .1749 0.0688 
D . 0259 .0852 0.0749 
16 А .0591 .1186 0.1145 
В .0508 .0303 0.0507 
D 0:28 C .0690 .0414 0.0841 
0.95 
D m .0831 0.0435 
For the normal distribution D < D for all cases and the value of 
max 0.95 
DEN. is more consistently least. The Gamma distribution fit failed the 


test for two cases (64 interval, instruments A and C). 
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test, instruments A and C). In the majority of cases the normal hypothe- 
sis provided the best fit to the experimental data. It was thus concluded 
that the normal hypothesis could not be rejected and it provided the best 
fit of the distributions tested. 

Similarly an additional determination of fit was made by summing up 
the absolute differences from the hypothesized distribution and the 
experimental data. Tabulated in Tables 4 and 5, again, the normal 


hypothesis consistently provides the best fit to the experimental data. 





TABLE 4. Summary of Results of Absolute Differences of Goodness-of-Fit 
Test for Eight Subject Average 


Number of and Experimental Data 
Intervals Instrument Normal Gamma Uniform 
A .0973 . 2594 .1338 
B “1461 2580 . 1703 
64 
C (1155 2200: .1499 
D .1091 . 2929 .2413 
А .1100 .1799 . 1651 
B .1467 2510 1414 
32 
C . 2871 .2156 .3365 
D .0315 1507 . 0460 
А .1791 .1754 (1146 
В 20612 .1126 . 0467 
16 
C 1287 .1513 .0141 
D . 1548 .1081 11552 


Sum of Absolute Differences betveen 
Cumulative Hypothesized Distributions 








TABLE 5. Summary of Results of Absolute Differences of Goodness-of-Fit 
Test for Subject Number Seven 


Sum of Absolute Differences Between 
Cumulative Hypothesized Distributions 





Number of and Experimental Data 
Intervals Instrument Normal Gamma Uniform 
A 0.3330 0.6386 .5266 
B 0.1291 0.4646 22325 
64 
C 0.1016 0.5609 . 2169 
D 0.1474 0.3627 . 0888 
A 0.3082 0.3360 . 3126 
B 0.0888 0.1608 21577 
32 
C 0.1680 0.1994 .1499 
D 0.0667 0.1763 .1019 
A 0.1721 0. 3664 . 2293 
B 0.0795 0.0603 . 0715 
16 
C 0:1717 0.1056 .1632 
D 0.1300 0.0859 .0691 














ESTIMATING RECORD LENGTH 


Next in the analysis was the application of the experimental results 
to models of record length estimation discussed in the section, Theo- 
retical Models for Estimating Record Length. Since the normal hypothesis 
could not be rejected and consistently provided the best fit to the 
experimental data, it was assumed that sampling was from a normal popu- 
lation. Two models of record length estimation were investigated: the 
normal, assuming that the experimental data mean and variance were without 
error and the t model, assuming the standard deviation was unknown and 
the sample standard deviation must be used. 

Tolerance on the mean, as a percentage of the mean, were calculated 
for three segments of experimental data, each of six intervals (55 frames 
per interval) and projected to a full 64 intervals by the previously 
developed relationships 

for the normal distribution, 


tolerance on the mean = z m o vn and 
o vn = 
777 





for the t distribution 


tolerance on the mean = tay? 5 vn 
— 
x VN new 


These tolerances were compared with actual tolerances on the mean obtained 





from the full 64 intervals of experimental data. Interval segments (n) 
used were data intervals 1 through 6, 31 through 36, and 51 through 56. 
This procedure was conducted for instruments B and C on the experimental 
data for the eight subject average, subject number three and subject 


number seven. A 0.80 confidence interval was used in determining values 
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for 2 and ya 

As the results indicate in Tables 6, 7, and 8, the tolerances on the 
mean calculated for the three six intervals of data and projected to the 
full 64 intervals provide a conservative estimate of the actual tolerances 
on the mean found for the full 64 data intervals. The t model assumption 


results were more conservative than that for the normal population 


assumption. 
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CONCLUSIONS 


The theory developed by Wierwille, based on the hypothesis that 
operator eye fixation probability estimates for fixed length segments 
of time follow a normal distribution, cannot be rejected based on the 
experimental results obtained herein. The theory enables the application 
of known statistical concepts widely used in engineering to the problem 
of record length estimation for taking data in support of panel redesign. 
In gathering data from a preliminary design configuration the following 
steps should be followed in support of the redesign effort: 
1. From the data sample break the data into n observations of 
equal length t, where an appropriate value of n is six. 
” Select a typically used instrument on vhich to apply the 
theory. 
3. Calculate the sample probabilities for each of then 


observation intervals. 


4. Calculate the mean of the n sample probabilities. 
5. Calculate the sample variance. 
6. Enter the normal or t distribution tables and calculate 


confidence limits (t distribution assumption is more con- 
servative than the normal assumption). 

Ts Determine the amount by which the confidence limits must be 
reduced. 

8. Calculate the required data length ee 

Thus the design engineer is able to calculate an estimate of the required 


data length to obtain an accurate estimate of the probability of fixation 


or link values. 
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The major contribution of the research conducted has been the 
experimental validation in one situation of a general technique for 
handling the problem of data taking in support of layout of instrument 
panels utillzed in dynamic man-machine systems. The analysis has also 
demonstrated the stability of human operator data and a procedure for 
the estimation of record length to obtain certain desired accuracies in 
panel design. The procedures developed provide a tool to the system or 
design engineer that assist in the determination of optimum instrument 


panel configuration early in the design process. 
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APPENDIX A 


Relationship Between First and Second Order Probabilities 


Lij = link value between instruments i and j 


+ Р:: 


ji ” Кӱј длр where K. is an arbitrary constant 


Lii is not defined 
Lij is a non-normalized link value 


The link value probability is given by the relationship 


i Lij 
ə ə ae 
izi jain 


where N = number of instruments and 


N-1 N 


E (1) 
is] j=i+1PLij 


The sum of all off diagonal probabilities of a probability matrix is 


given by 
DB Pis ibn) | 
N-1 N N-1 N 
A 
1=] j=itl . Jl 4=1 j=1+1 = 
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The sum of all probabilities of a probability matrix minus the main 


diagonal probabilities is 


N N N N 
È È Pi? - Ue Ops pn 
i=] j=l 1=1 i=l 
N N 
Ky 7 = DG = İn (from relationship (1)) 
=1 3=1+1 
therefore 
N 
eA eh 
1=1 


Substituting into (2) above gives the relationship between second order 


probabilities and second order link values 


DP: : + p.. 
рә, 11 ji əri 
Буј N for 1<j 
1-2 
je) di 
undefined for j-i: 


Under random scanning but allowing for different frequency of use 


5001 
7.2 
1575 
- 2рур: 
Pi; 1 J 
E, 
1575 





APPENDIX B 


Instructions to Subjects 


You are about to participate in an experiment that will record your 
eye movements and control movements. An analysis of these movements and 
that of other subjects will enable the development of a model which can 
be used in support of an instrument panel redesign. 

You will be seated in front of an instrument panel on which four 
meters have been mounted. During the performance of the experiment, you 
are requested to scan these meters. Your head movement need not be 
constrained. During the running of the experiment, input signals will 
cause random deflections of the meter pointers. When the pointer is 
located outside of the color coded green tolerance area - that is in the 
red region - you are requested to initiate corrective action to bring 
the pointer back in the green region. Your objective is to maintain as 
many of the pointers as possible within the green region. This action 
is accomplished by movement of the respective control potentiometer 
located on the manual control box. The physical arrangement of the four 
potentiometers is compatible with the meter arrangement so there is no 
need to visually verify that you are manipulating the correct control 
potentiometer. 

The camera, which will photograph your eye movement, is mounted in 
the center of the instrument panel. Please make a conscious attempt not 
to be distracted from only viewing the four meters. 

The total experiment will take approximately fifteen minutes to com- 
plete. It will be broken into two segments. The first segment lasting 


five minutes will consist of a practice run that will enable you to become 
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familiar with the equipment. Next there will be a two minute rest 
period. You will then be given another one minute period of practice 
that will directly lead into a four minute data collection run. 

Again, I would like to emphasize that during the performance of the 
experiment you are asked to perform the following: 

Ју Scan the four meter instruments. 

2, When the pointer of an instrument is out of tolerance, initiate 


corrective action on the manual control box. 


3,4 Maintain as many of the pointers as possible within the green 
reoıon. 
4. Consciously attempt not to be distracted. 


The personnel working on this experiment greatly appreciate your 


assistance. Do you have any questions? 





APPENDIX C 


Determination of Bins in Analyzing Data 


First Order Probability of Associated Bin 
Instrument Being Viewed Assigned 
De x < 0.07143 l 
0.07143 < x < 0.14286 2 
0.14286 < x < 0.21429 5 
719 < x < 0.28572 4 
25 :/Z < x< 0.35715 5 
7.05 S x < 0.42858 6 
0.42858 < x < 0.50001 7 
0.50001 < x < 0.57144 8 
0.57144 < x < 0.64287 9 
0.64287 < x < 0.71430 10 
09714305 x < 0.78573 11 
27? /5£ x < 0.85716 12 
7 716 < x < 0.92859 13 
355 559 x< 1.0 14 


Utilizing the above equal size bins for analyzing the data for the 55 
frame interval or a multiple thereof the following is noted: 


Number of Frames Viewed in Bins Assigned 
a 55 Frame Interval 


LS 


O through 3 1 


4 through 7 2 
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8 through 11 3 
12 through 15 4 
16 through 19 5 
20 through 23 6 
24 through 27 7 
28 through 31 8 
Sep through 35 9 
36 through 39 10 
40 through 43 11 
44 through 47 12 
48 through 51 13 
57 cnrough 55 14 


Therefore, Ü through 3 counts fall in the first interval, 4 through 7 
counts fall in the second interval, etc. With four counts assigned to 


each interval there 1S no bias on an individual data frame. 





APPENDIX D 


Normal Approximation to the Gamma Density 


As the gamma density function parameter n increases in value beyond 
unity the gamma density becomes more substantially bell shaped. There- 
fore, a normal approximation can be used with relatively small error. 
Such an approximation simplifies computations associated with fitting 
the gamma distribution. 

To approximate, one procedure is to set the variance of the gamma 
distribution equal to the variance of the normal distribution and to 
set the peak value of the gamma distribution equal to the peak value of 
the normal distribution. 

This procedure is developed below, and has been applied in this 


thesis. The gamma density function is given by the relationship 


À 
f (xo) = (n) (AX, 


00 vhere 





) 


1 


mean (m) = 


i n 
variance (g? ) = — 
\2 


and Xə”0, A?0 and n € 0. 


The parameters defining the gamma density are calculated from the 


relationships 


tə 


sn _ 
= 2 and N = 


la 


a 
rə 
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The peak of the gamma density is found from the relationship 





n-1 En = n 
er “ О = A (Ax) (- À e Хој 7: AXo(n-1) (AX) 


and solving for the peak value 





ән ии. 
° À m 


The normal probability density function is given by the relationship 


- (x-m) “ 
70 








E = | 
ix “əz 


Therefore the normal approximation to the gamma density is given by the 





relationship 
2 
A) 
1 2 
O e 20 
- o V2T 
ease 
where инк 
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RECORD LENGTH ESTIMATION FOR 


TAKING DATA IN SUPPORT OF PANEL REDESIGN 


by 


John J. Seeberger 


(ABSTRACT) 


An investigation was conducted on the determination of record 
length estimation for taking data in support of an instrument panel 
redesign. The stability of human operator eye movement data and 
estimation of data record length required to obtain certain desired 
accuracies in the estimate were experimentally investigated. A model 
was developed to provide a general technique for finding the optimum 
design and layout of an instrument panel used in a dynamic man-machine 
system. The model is based on the assumption that eye fixation 
probability estimates for fixed length segments of time follow a 
normal distribution. 

Ten subjects participated in the experiment, conducted in a 
laboratory environment, to collect data on eye fixation probabilities. 
Various probability distributions were hypothesized with the normal 
hypothesis consistently providing the best fit to the experimental 
data, 

The procedures outlined provide the system and design engineer 
with a tool to ensure optimum instrument panel configurations are 


defined early in the design phase. 
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